4. 



Select frames with a fixed interval from an input video sequence 
and create the feature frame matrix A 




102 



Perform SVD on A to obtain matrix with columns representing 
frames in the refined feature space 



In the refined feature space, find the most static cluster, compute the 
content value of this cluster and use this value as a threshold to 
cluster the rest of the fi*ames 
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For each obtained cluster find the longest video shot in the cluster. 
Discard clusters with the longest video shot shorter than 1 second 



105 



According to user request output a set of key firames representing 
fi-ame cluster, or a summarized video with user-specified length 



FIG. 1 



In the refined feature space, sort all the vectors v|/j in ascending order using 
distance defined by Eq. 4. Initialize all the vectors as unclustered vectors, 
and set cluster counter C = 1 
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Among the unclustered vectors, select the one that is closest to the origin as 
the seed to form cluster S^. Set the average internal distance of the cluster 
R(Sc) = 0, and firame conunand Pc = 1 
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For each unclustered vector v|/i calculate its minimum distance to cluster S^: 
dmin (Vi.S^ = minD(\|/i,\|/^ 
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Add firame to cluster Sj 



208 
Yes 



Add firame to cluster 




No 



Yes 



1 
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Terminate the operation 



Increment cluster coimter C by 1 
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FIG. 2 



FIG. 3 


No 




r 


Sort shots Gj in descending 
order by length, select the 
top N shots, and assign 
equal time length T^j„ to 
each selected shot 



For each cluster Sj find the 
longest video shot 9} 



/I/ 301 




Yes 



Select all the shots 0j where 
i = 1, 2,... C, and assign 
equal time length T^JC to 
each of the shots 



/I/ 303 
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Sort the selected shot by the time 
code, based on this sorted order, get 
from each selected shot a portion of 
the assigned time length, and insert it 
into the summarized video 



4/305 



FIG. 4 



Sample the input video 
sequence witii a fixed rate, 40 1 
and create a feature-frame 
matrix A 



Perform SVD on A 
to obtain matrices E 
andVT 
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Compute similarity SIM (i, 
i+1) for all frames in the 
sample set and segment the 
video sequence into video 
shots along the time axis 



/I/ 403 
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Compute the average feature vector W 405 
for each shot 0, 



FIG. 5 



Set 
S=l and 1=1 
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Create shot 9^ with 
frame I as its first 
element 



A/ 
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Insert frame I+l into 
shot Gg, and set 



1=1+1 
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511 



Mark location 
between frames I 
and I+l as a shot 
boundary 
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No 



S=S+1; 
1=1+1 
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Find tiie fi^e x>I+l 
that satisfies 

D(Vx.Vx+i)^Ttow 
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Yes 
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Mark the frames 
between Rl and x as a 

gradual transition 
between the two shots 
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Group frames from I+l to 
X into shot G^, set I=x+1 
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Terminate the 
operation 
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